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v - - Focusing* on the promotion of reform and knowledge 

in school districts, this paper reports on data from a study 
investigating assistance and enforcement strategies, adopted by three \ 
types of regional educational service agencies. Assistarice> in this 
' 5 . context means provision of legal or program knowledge needed to 

operate successful programs. "Enforcement means jaipnitoring 6t programs 
to make sure regulations pr . mandates are being carried out. The 
research project ask& twcKguest ions :, Do individuals* who play 
enforcement or ' assistance roles |eel comfortable combining the two? 
and, Can the two roles* sticc&^ffully be combined? Data were ' collected 
from intermediate*uftijts in Pennsylvania and educational improvement 

• centers and county'omqes'of New Jersey. Data were collected through 
site visits incorporating questionnaires and interviews.. Findings 
♦indicate that those charged with enforcement responsibility would 
also like to provide assistance. These are important limitations, 
however'f to the 'kinds of assistance they carv provide. ^'They £an link 
districts to source? of training and^ specialized assistance but they 
cannot provide these services" themselves because 4£ time' 
constrictions and. because local educators seem; unwilling to utilize 
"assistance from individuals W)io .alsa fcaye monitoring . 
responsibilities. (Author/JM) • . 
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' - ^ ABSTRACT 

State and Federal agencies use both enforcement and assistance/knowl- 
edge transj^^^^a^ strategies to promote ' locaL reform. 'While research* has 
been conducted on each strategy V there has been little effort to examine 
hdw. they can be. combined*. This* paper reports on data from a study which 
invest igafees both assistance, arfd enforcement strategies adopted by three 
types qf Regional Educational Service Agencies created to promote* knowledge 

use in schpol. The results indicate that enforcers want to work more in 

• \ 

s 

the helping mode and that th6*two responsibilities are difficult to com- 
' bine. Implications of these findings are offered for both the research and 



policy communities. . 

• •■ ■ . A 
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ASSISTANCF AKP ENFORCEMENT AS STRATEGIES 
FOR KNOWLEDGE TRANSFER AND PROGRAM REFORM 1 



A majo'r^ task for state and federal agencies responsible for program 
implementation* is to shape the b-ehavior and objectives of agendas at lower 
levels (Bardacfr, 1977; Elmore, 1978; Pressman and Wildavsky, 1973) ^ Even 
where program implementation is not an issue, government agencies may 
have to work ttirough other units to acctamplisb thefr purposes. Thus/ the 



National Institutes of Health, and the National Institute of, Fduc^tion are 

responsible for seeing that research on" specific topics is conducted by 

• . v * ■ 

? * ■ 

universities and private organizations and then for promoting the use of 

that research in a variety of hospitals, mental hospitals, and schools. 

" ""v* ■ . • . „ - *- ** * ■ 

To obtain the cooperation of other- organizations,, the initiating $^ncy 

may rely on any of a number of strategies intJudii^g the generation and. 

enforcement of mandates * (Elmore 1980; Iannaconne, 1981) and the 

dissemination of -knowledge through the use of human "linking agents" 

(Hood and Cates, 1978) > and through networks A \>r interorganizatLonal 

arrangements (Hub«rman et al. , 1981). There is a". growing disenchantment 

with the use of enfbrcement that is apparent, not only in ^the policies* of, 

the Reagan administration, but also in the writings of * policy analysts, 

(Bardach, 1977; Berma*, 1981; ^mojre, 1980).' Yet, these 'same analysts 

recognize that there are situations when enforcement 4 may /txe a 

tfov/ards program reform if it is cabined with &6me sort of assistance. 

■ i * * * * 

i j f i 

Meai&hile, there is § growing body of v literature 9 tahich ^has been 

» * . • ' 

summarized by Louis (1981) which suggests that," at least in tfie CLeitf'ef 

education, assistance, strategies, using human helpers- are. effective * for 



\ 



\ 



stimulating change at the local level and ei&ouraging the use of knowledge / 

I 

to imp-rove practice. . Even here there are reservations, however, because 
of the' .fear trtfat districts most In need of reform wilL not take advantage of 

available assistance (McLaughlin, '1981). It seems likely that^ some 

♦ + 

cpmbination of. enforcement and assistance might fre most effective to 
- r * ' * 

* f 
improve practice and get knowledge, into use. As Henry Brigkell (J980; % p. 

202) suggests^ "The classic one-two prtincK^ in educational change is a, 

stinging mandate followed- by a* powerful # technical assist." However,, 

research on these two refornr strategies has proceeded on separate lines so 

.the^re is ^ery little guidance as to how to combine enforcement and assis- 

tance in the most effective manner. * , , p * % 

* This papef uses data from a study of Regional * Educational Service 

Agencies CRESAs) to explore- some of* the issues related to combining 

,\ ' . 

enforcement and assistance to promote program reform and knowledge use 
\ i • - - * 

v i * . 

.in education. In . 39' different state?, RESAs # >form a latfer of agencies 
between the. state and local levels of education (Yin^and Gwaltney, 1981). 
"They serve' a variety of functions^iircluding providing training* and 
technical assistance services. $© school districts and, in. some states, 

> * * 

en facing state 'and fede-ral statues ♦ ~ We' will, focus on % the< field staff 
employed by the RES A to work with school systems to learn more about the 
asibility of combining enforcement and 'assistance activities ill the same 



j en 



position . " . i' 

Enforcement and Assistance 
In Che last decade, there has been a major increase in the use of 
legislative and regulatory mandates to* promote reform in education., . . 



- * ••• • * • . ■' 
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•Federal mandates refer primarily to equality of opportunity — especially 
school desegregation, the treatment of the handicapped,, sexvdiscrimina- 
ti}>n, and hiring opportunities.. More recently, there has been a major 
growth in mandates* at the state level as well (Wise, 1979). State 
♦governments have required various forms of PPBS ^(program planning and 
budgeting systems), curriculum planning procedures, minimum, competency 
testihg, „ and high school graduation requirements * as well as older 

. ' ; 

• regulations governing staff certification and the allocation, of time to 
different curriculum areas. The growth of regulation' has slowed in the 
new climate created by the R^afean administration*, "but it is too soon to 
know Whether this period aLs one of reversals — as Kirst and Jung (1980) 

• suggest—of retrenchment. ; ' ■ . * 

; Whatever the future of enforcement efforts as refdrm strategies, 

there has-been considerable discontent witly th^ir results* to date£ In 

* * *» , * 

•m * * • 

fact they "have of ten misfired in one' of two ways. * "tffrst , In many 

* * ■ « V 

situations there has *been substantial noncompliance, with many of these 

J - * * / * ' 

mandates (Boyd, 1978):- For instatiqe, major -provisions' df Title. I of ttfe 

Elementary and (Secondary Education Act were sirapJLy not ' f olJ.ow<ed for the 

first five yeark^ter it' was passed <MurpHy, 1971) although the situaV 

as s^ince improved jCKitfet and Jung, P980).«* A 6econd problem, has , to 

do with the displacement of both district compliance and state and- 

federal monitoring efforts. The fmphaWs shifts from fallowing the 

spirit tossrfol lowing,' the letter of the law. Thus, there is more concern 

with seeing '.that rules and .regulations such'as allocatiom forpulae are 
_ . * # • 

followed than for making .sure that children are better served (Elmore,- 



There are undoubtedly a number of reasons, for the disappointing 

efforts to promote reform through regulation. One that '4s especially 

relevant to those -interested in knowledge use stems ftW a failure to 

> 

distinguish between the aVsence of the will to comply and .limited 
. capacity. According to Barman C1981 ) , the theories that policy makers 
and implementers Cise explain the ineffectiveness" of enforcement efforts 

\ ' * < : . • 

by referance.Sto resistance at the local level. However, even when bKe 
• ji • .% • 

will is present, compliance with many' mandates requires 'substantial 

- u . - . - " • ' r J ' 

changes in both the organization for service delivery within educational 

* % • • , * • 

agencies and -in the skills required -for> instruction, » These require thatr 

> - V 

local educators develop skills and knowledge not currently availably to 

them. * Jfc 

' / ' * 
In fact two kinds of knowledge are ne'eded as can be seen from 

i • '* ' . > " • - > . 

McLaughlin 1 p (1978) analysis of implementation failures related to Title 

% * • r 

I. The first is legal knowledge, an understanding of^jrhat regulations 
really require. In the late 60s and early 70s,^Title T ^regulations -wp^e 
,ldng, complicated, and not summarized in .a succinct undexstandable form. 



9 * *- 



As a result, local educates wdre unsure of what ^as required of them 
when they did try to comply. 

The second kind of knowledge^ relates to > program concerns. When 
Title I was 'passed, it was assumed frhat the compensatory, programs for 
raising - the skills of poor and underachieving students were readily- 



skills of poor and underachieving students were read: 
available. In fa'ct, they were not. Even when they became available, 



.JoCal educators »did not % always • know about them untif more effective 

disseiginatiQn systems became available*to spread sucft -knowledge. 

If! 



These studies suggest that compliance within the spirit of reform 
% ' . \ * i ' * 

legislation can be facilitated by increasing the access of . local profes- 
sionals, to fche legal and. program knowledge needed to operate successful • 
programs. within* the law. Thus", an important question is how can sfuch 
access be improved? t ' 

In the last decade,- a body Of evidence has 'developed whjLch shows 

that dissemination systems that pit human helpers in contact with .school , 

systems are effective -in putting sujch knowledge to use. This evidence 

comes primarily from' evaluations of four federal programs that use 

helpers a,s an important part of their dissemination and implementation 

efforts- 'The Pilot State ■ Dissemination Project of the late 60s' (Louis 

and k Sieber, 1979), The National Diffusion Network (Emrick, Peterson, and 

Agarwala-RoVs, 1977), The State Capacity Building 'Grants ' Program 

^oyster et aj... *981), aitf the Research and Development Utilization 

Program (Lquis, Rosenblum and Molitor, 1981). . „ 

,* » • 

To show the . importance of hands-on assistance/ these successful 

caseslfean- be contrasted to a program to develop Pr^ect Information- 

Packages (PIPs)— sets of ■ materials designed > provide local . educators 

'with the inflation needed to install an^ operate * effective, approaches 

for compensatory education. These P^Pa were not to be used, with external 

human" assistance.' However, the evaluation of the program's pilot-efforts 

indicated that the use^of PIPs 'without human assistance 'was unlikely to 

. 1 

.lead to complex organizational and behavioral "changes ^(Stearns and 
Norwood, 197?). More generally, a • review' of twenty, years of curriculum* 
development work indicates that efforts to put, those curricula into- ■ , 



4 ^ 

practice without extensive networks of human helpers and disseminators^ 

has been relatively unsuccessful (Welch, 1979). 

Although -most of ' the relevant > research Tfas come from examinations of 

s, there is some confirmatory data from research on RESAs. 

Case studies of three such agencies""as networks for knowledge utilization 

explain their success by pointing to the- informal interpersonal networks 

that are created between RESA Ifcaff and the educators served by those 

agencies (Yin and Gw^ltney , T981) . 

.It has been fairly well established that human helpers can promote 

the use of knowledge to improve educational practice. ~ However, there, is 

.an important caveat to generalizing frelfi these studies to situations 

where such assistance might be used in conjunction with enforcement 

ef-forts: Human assistance strategies rely heavily on the voluntary 

development of the relationship b'etwejen -the assister and, the .recipient. 

Careful observational studies of a series of school improvement efforts 

relying on human helpers indicates that there are serious limitations to 

the influence those individuals -fan exert. 'For instance, whenever 
• * * « * 

t'ension . develops between helpers and school' staff, it is consistently V 

resolved \n favor of the schools., indicating * ttiat helpers -can only play 

the roles local educators allow them to play. Moreover, school ccfndi- 
. • * * • i 

tions are najor determinants of the helpers behavior. In addition, ' 
successful outcomes of the change projects • are * more closely associated 
-with teachers 1 , principals 1 , and the district administrators 1 ' perception 
tfcat a significant problem is being addressed^than with any behaviors of 
the helpers (C6ffre* t , * 198 1 ; Firestone and Corbett, 1981) ♦ t , 



Such findings suggest that combining enforcement and assistance 1 

activities will chdnge the dynamics of the assistance relationships in 
X - • • ■ * . . 

ways that . may undermine Assistance work. On' the other hand, assistance 

t 

efforts that are not combined with some enforcement work have been 

criticized as , not reaching the schools with .the greatest' rifeed. If 

assistance is only available : .on request, the most • sophisticated, 

prog^sive districts may 'be -the most- lively to- seek It ratfier than those 

with. the weakest programs (McLaughlin, 1981). Thus, while 'there seems to 

' be good reason to combine enforcement and assistance activities, there is 

some : question as to whether these two approaches are really compatible. 

Tb explore this issue; we will ask two questions:, Do individuals who 

-play enforcement or assistance ' roles feel "comfortable combining the twor 

i - « ,' . . . • . 

and whatever people want, c^n the two roles be combined in practice? 



1, Do monitors and assisters" want to combinrerrolefe? 



-r- 



There is very little research on the first question because there 

have been very few studies- of the monitors respojisible-f or ensuring that 

regulations are canri^d out and because the existing studies of assisters 

have not explored issues related to compliance. Examinations of Title I 

monitors 'indicate that they were, initially at least, indisposed to be 

"aggressive in ensuring that mandates were carried out tor two reasons. 

First, as professional educators they identified clpsely with the people 

* t \ * . . - _ ' ' 

they were 'monitoring. Second, at that time, the state and federal 

***** JSl 

agencies »re sponsible for monitoring compliance faced a strong coition 
of * professional associations committed t to defining Title I funds' as 
general aid,. This coalition was strong enough to deflect enforcement 
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10 x 



efforts 'and even threaten the responsible agencies find officials. Thus, 
an unwillingness, to -take a strong moni-toring stance reflected the 
agencies' survival .needs. (.Murphy, 1971).' This research does not indicate 
whether these monitors were willing to adopt active -assistance roles-* 
However, in a study of project officers in a later reform effort, Corwin 
(1977)' found a willingess to combine', .enforcement and .assistance 
activities. Moreover, the project' pff jeers he studied indicated a strong 
preference for the latter activity. Although these studies are only 
suggestive, .'they indicate considerable' dislike for the monitoring or 
enforcement role and; at 'least in some circumstances, a preference for 
assistance. '< ^ - 

2. Can enforcement ajid" assistance be combine d in one position? < 
While th'e the combination of assistance and enforcement in the same 

% * t 

reform efforts would seem to benefit both, at least two difficulties can 

be anticipated to. combining- both sets of duties in the same role. The 

first -is the problem -of role overload. The effort to. have one person 

carrv out two complex functions could create a situation where neither is 

done well. Th/ project 'officers studied by Corwin ' (1977) combined 

J - *•* T. 

enforcement and assistance activities. However, they onir handled from 

two to seven, projects* each "of which- was an award to one small school 
•district.' Thi's-is an unusually low number of projects. By contrast the 
'early Title I monitoring offices examined by Murphy (197l3\were so' 
severely understaffed .that they' coulTnot seriously consider t/ie possi- 
bility of offering substantial assistance". 



The second problem is one 'of trust, 'For helpers to be effective, 

the client mus't be, able to share a great d£al. of information^ about the, 

- . ' ^ >. * -> • • 

internal problems' of a school. For instance, many of the assistance 

programs begin ^with some sort 'of needs assessment /activity " (touis , 

Bosenblum and Molitor, 1981; Vpuis and Sieber, 1979).. If the^lient is 

unable to share . potentially embarassing or damaging .information, later" 

assistance? efforts could be significantly misdirected. ' Such might be the 

case' if the helper is 'also. a monitor .charged with enforcing legal man- 

t * 

dates. - • . 

To address" these issues, we examirfe the work of field staf f in 'three 
sets of BESAs in 'Pennsylvania "ard^ New" Jersey^ ' The 'sample of agencies 
chosen is useful for two reasons. First, they have very different, formal 
missions with regard 'to assistance' and enforcement activities. Second,^ 
bv_f_ocusing on these agencies', it is possible' to cut across several 

'programs arid mandates. Before, addressing these questions, the following 

• * - 

sections introdtfc£v-the~agencies and describe our. research ^methods. 
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■ ' The Agencies J - ' • 

In 1979, we began a • program^ research. to explore hoWBESAs contri- 
bute to knowledge' use. The study examines Pennsylvania's Intermediate 
tfnits (TUs) and. the Educational 'improvemeat Centers ^EICs) and County 

Offices of New Jersey. 2 ' Pennsylvania' s 2$ IUs wyare formed in 1970 when 

* \ ■ % * 

the state 1 s county . of flees reorganized after a massive program of 

t * * . v * 

district consolidation. They have a broad mission to provide specif 
education, curriculunTdeveloplhent, educational planning and a, variety of 
other services. Tp addition they way offer any other services agreed' to 



- / 



\ i 



* by a majority' of school boards in the regions served fDarfo, 1976). Over 
80% of TU budgets in the '70s were fot the operation of special 
education programs} ' special education funds, go -to TUs rather th'an to 
school districts in Pennsylvania.' The average TU has. 24,1 staff,- and the 
\ largest portion '.of* these people are 'special education teachers^ and 
^ supervisors. In the special ^education ' area , 'these agencies have some 

•' -.enforcement responsibility since they must ensure that their own staffs 
and .school district educators follow state and federal special education 
mandates, including those requiring that, children be "mainstreamed"-, 
i.'e., placed in regular classrooms— wherever possible and bbat an indivi- 
dual educational plan (IEP) be- developed for each special education 

student. * 

Tor the most- part, however, TUs promote the .image of a general 

• assistance agency' providing help in many areas including those outside ^of 
special education. Most have, from one to 12 individuals who provide 

; training and technical assistance services in a variety^ curriculum and 

administrative' areas. Thefe , people coordinate regional inservice 
. programs, provide workshops for; specif ic districts, serve as consultants 

• to curriculum development efforts, and coordinate contacts between the 
region and assorted state and federal educational agencies. The average 

■ *K IU selves a region of over 1600 ' square miles* including- 19 'school 

districts. , »"'.'' W 

. New Jersey's f^ur • EICs were formed between 1967 and 1975. Their 
t^ssion is* to "^R request. . . provide support and- assistance to local 
school' districts and -tp members of teaching an/ administrative staff 
. • / through the delivery of materials, techniques andlexpertise necessary to 

• • 13 

10 



improve school programs anfl services" (State *of New. Jersey, Chapter 58, 

/ •• * 

Xa\rs of 1978)* Thus their mission is narrowet thap that of the TUs and 

focuses specifically , qn I provision of knowledge through' training and 

* * ,.* ^ x 

technical assistance. , • They do . nor provide services to. students. - Ej£. 

staffs fluctuate considerably in size because these agencies rely heavily 

t; \; * V / ' 

on special program funds; won from state and federal agencies V^n 1980, 

the average ETC had approximately 60 staff, half of them served helping 

■ * ' ' 

roles by offering workshop? in a variety of content areas *to, school 

districts, providing <*Qi^8ulting services in those same areas, and operat- 

* \ *' i, J ( 

ing a smhll resource^ center/library. { The average EIC serves 148 dis- 

tricts spread over I960 isquare miles. 

' / While the ETCs and/ IUs have their own^boards of directors, New Jer- 

sey's 21 County Offices operate as branch offices of the State Department 

of Education, and their responsibility is "primarily regulatory. In 1975, 

New Jersey passed its Thorough and Efficient Education law (T&E) which 
* • & 

required among other things, that school districts follow a state mandat- 
ed planning process, and that schools achieve above minimum criterion 
levels of a state-designed basic skills test. Should districts not meet 
these requirements, the state can legally take over operation of the 
district (New Jersey Stafe ^oard of Education, 1980). This st^te educa- 
tion legislation is among the most regulatory in the nation (Wise, 1979);* 
and sinfce its passage, the legislature has passed additional laws and 
mandatory 'high •school graduation competency requirements as well. 

. From 1975 through 1980 County Offices were responsibly for monitor- 
ing school districts to ensure 'that they - complied with state require- 
ments. Since 1980 although the monitoring responsibilities have not been 
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relaxed, the New Jersey Department of .Education has encouraged the Countv 

' * * ' ' /• 9 / 

Offices to take on morels si stance roles as. we]]. The average County*- 

* . • 

Office has .seven "professionals, six of whom worl< in- the field by visiting 

schools to monitor x compliance, responding to requests for information, 

and ' overseeing^ local*career education, vocational education, andT -special 

education programs. 

Data. Collection 
* * • 

- In tfie fall of 1980, ,s(ite visits were made 'to 23 agencies: II TUs, 
two EICs, and 10 County Offices. These agencies were selected affcer 
consultation with sta££ department staff and agencv directors to ensure 
variation, in size, — population t density, distribution throughout; each 

state, and reputation for, helping educators keep abreast of knowledge 

^ 2 *_ i I * _ 

relevant to their work. Tft was as.sumed* that tfie best information on 

the nature of the assistance and enforcement roles played in*5ach agency 

would come from the field stafT. Therefore, in each agency data were 

e > " " 

> i 

collected from three to 12 field staff. Thesp individuals ftere selected 
by the agency director after discussions with* the research staff to 
clarify that we were looking for individuals doing assistance or 
enforcement' work. Peoplte providing direct * instructional services 
^pr^marily in the IUs) or supervising such work were eliminated.' In the 
1^ , smallest agencij&e we, collected data, from all agents available, and in 



w . . * 

the *test more thanlhalf were included. Each field agent was interviewed 

& - * 

for approximately ypne^hour and asked to complete a 'questionnaire. 
Complete data were obtained from 138 individuals. 



y , Mission and 'Action 

Before addressing the questions about assistance and enforcement 
raised above, it is important to determine which agencies 'played which 
Vole! A 'review of the missions 'of the three types of agencies in the 
study suggests that County Offices ar.e enforcing -agencies while EICs and 
'iUs-are more assistance oriented. However, McLaughlin (1981)- notes that 
some state "agencies charged, with enforcement .responsibilities actually 
phas£e providing assistance!' Hence,, it is important, to know what role 
'individual field, staff actually play. The survey ' administered tq all 
field \taff <N»138)' included one question asking to what extent each 
individual played 11 different roles. A factor, analysis of these res- 
ponses identifies three different types of -activity played by. agency 
field staff. 4 The definitions and items which; make 'up these three roles 



are as follows: 

» 

• Expert /Trainer 



Definition: A specialist in a specific area who makes 
knowledge available to schools through 
workshops, inservice, and/or more intensive 
consultations. • 

Ite&s: 1) Expert on a curriculum area * y 

2) Workshop'^presenter 



• Liaison 



Definition: A go-betweerii who does not provide knowledge 
directly , but who helps schools diagnose 

f . problems, fi,nd resources and/or match appro- 

priate clients with resources. . # 



• Items: 1) Resource finder 

2> Needs assessor/planner 
3) Coordinator 



• Mon itor ' * * ' . 

: 1 • » «« 

Definition: Sonfeone who collects information from schools 
• ~ to determine their compliance with law and 

£ode. > 

i * " . „ • 

Item: * Monitor who identifies discrepancies between 

regulations and practices. 

♦ 

Basically, 'monitoring is an enforcement activity while training and 
\ 

liaison are forms of 'assistance. The di£ferehce between the latter two 4 
activities is partly in the kind 6f assistance. Trainers -are more likely 
to work through issues with local educators and to provide^, training and 

r 4 ■ . i 

assistance* to solve problems while liaison people identify needs and find 
resources, including trainers. 

Individual field agent scores were computed for each of the three 

- < 

roles. 5 These .individual scores were then aggregated to dktaiti a mean 

6 — - 

agency score for each activity. • ■ $ 

Figure 1 presents a bivariate-.scattergram distribution of the agency 



Figure 1 about here 



scores for the two activities of training and monitoring. As would be 

expected from a review of agency missions, there are two distinct clusters,. 

/ 

What distinguishes the two* groups is the extent to which they do ,monitor- 
ing. One cluster, including, all the County Offices and 'two small IUs, 

m 

monitors a great deal while the other does very little. The latter group 
includes both ETCs and most of the IUs. The training pattern is not quite 

4 • i' 

asniistinct, btit for the most part, the non-monitoring agencies do more 



f 

training Ithan the monitoring agencies. -Thus, our data suggest that it**' 

/. • - " j - " '/ 

makes sense to speak of sets of enforcement and assistance agendies. 

• • • . * 

• " Enforcers Seek Out Assistance Poles f f „ ' 

To examine how enforcement can be accomplished in educationist is 
instructivL to lookiat the New Jersey County Offices. They represent one 
of the largest systems for enforcement purposes in the coux0y. In 1975, t 
before the T&E law passed, the 21 County Offices were staffed by 56 profes- 
sionals. Most of these were in rural counties,' especially in the southern 
•part of the state- By 1978, the professional staff had grown to 155, all 
with some formal re'sponsihility to monitor compliance with state and 
federal legislation. In comparison with other programs, this is a favor- 
able ratio for monitoring' purposes.. With 573 operating school districts &i 



^~staTe~7^chere~ _ alre7^1^r6xiWtery ^50*— districts pel staff memberr- 

However, the County Offices have a broad mandate to monitor compliance with 

state mandate^ planning procedures, tenured teacher evaluation regulations, 

building codes., and budgeting procedures as well as federal- laws. They 

also are*' expected to visft Vll 2411 schools in the state annually. As a 

result, their monitoring burden is substantial. f > 

— Inte^Lews with the fi^ld staff of the County Offices indicate that 

* » \ 

they are often uncomfortable with the enforcement aspect of their work. 
Som^ seek; to deny that it exists: 



t The primary thought in our work is not to aci as a monitoring 

• • agent. . v , 

4 ^ 

1430 7 ,. 

t 4 * * 

— ' . 18 " 
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I don T t do checklist monitoring. T feel more like at TA 
person. I help districts identify needs. 

1531 * 

Tn many case^ they seek to define their work as an assistance 
activity: 



In the internal kind of work we do here,^ we try to provide 
service kinds of activities to local districts' in terms of 
f helping them meet all of the state and federal requirements for 
all the kinds of school programs that they offer. 

1730' . ■ ' * 

A lot of my time (one-half, to two-thirds) is spent on the phone 
answering field que^tigns. The rest of my time is spent doing 
policy clarification and giving solutions to problems in 
meeting state guidelines and mandates for special education. 

1530 * 

Some even seek to identify themselves with the districts they monitor: 
T am v iewed as an adjunct member, of the management team of the 



' , LEA . Tn some cases t give workshops, but I usually serve like 
an administrative role in the district.* 

.' . 2037 

There are two reasons for enforcemept staff to deny or downplay that 

aspect of their .woilc. First, thay are drawn- from* the population they 

monitor. The bulk of their previous work experience (83%) is in education, 

either as teachers or administrators ♦ Moreover, these people are-^fa^n 

from' the very geographic areas Obey ndw monitor. This is apparent in both 

their education and their experience. For instance, just over two-thirds 

of the field st^ff who score high on monitoring 8 ^ report that they received 

th^ir highest degree within commuting distance of the region they now 

serve:? Less than half of the rest of the sample received* their degrees so 

close to home. We also, constructed a localism-cosmopolitanism scale by 



expressing the field' agents 1 professional work experience as a ratio of the 

difference 5 between experience outside the state and inside the state to the 

total years of experience. Thus, large negative .scores indicate that the 

Jarrgest proportion ^df a person's previous experience is/frem the area where 

he or she now works-. The average score for the_.indi<uxduals whc^do monitor- 

ing is -.69 while that for' th^ rest of the sample 'is' -.46. ? • 

Second, the New Jersey Department of Education lacks the political 

muscle to monitor agressively even if fiel^ staff want to; Field staff are 

aware of their limitations. As one^f them explains ?'You can't hold it 

over their heads. You can't say 'its the law"' (1632).* Tn fact efforts to 

carry *out monitoring requirements have been costly to the Department of 

Education and its County Offices. In the summer' of 1978, the New Jersey 
« * 

Department; of Education's budget l\ne for County Offices was cut by one 

million dollars, a loss of approximately 45 positions. These positions 

were only restored . after extensive* lobbying by' the Department. 'More 

* ✓ ■ * 

recently, in the fall of 1981, both candidates foj governor of New Jersey 

stated that the Department's System for monitoring local districts was 

wasteful and expensive, and both pledged to change the system if* elected 

(Camden Courier-Post , 'October 20., 1981). Planners within the Department 

began seeking ways to recast the .County Office function almost a year 

berore election. 

J 

Enforcers Do Not Do' Training 
* • • • 

$ - . . 

Given the interest of, people with enforcement responsibility in 
redefining their toles, Aat options are. available? Is it possible to 
combine assistance and e«orcement in a single position? Examination of 

/, ' ; .. • . • • . ■ 
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the data on ffceld §taff activities suggests that mgnitoring^ is compatible 
with liaison assistance, but no£ with training. 



"The first siep^is 'to look at the Survey data on rojes played to see 

* ** - 9 \ ' * 

what combinations were apparent. The distribution of fsield .agents is 



presented in Table 1, 



Table 1 about^here * . ' */ 



The data in Table 1 suggest*that combining *two kinds of* activities 

■ '* '; : • -f 

not unusual {44 .individuals, score high on two* dimensions and 49 on ope), 

but that doing all* three is quite rare^. More to the point, combining 

* * * « * 

monitoring "and training is unusual. Only .seven people report doing so. 

However, combining monitoring and liaison is not so dif£i«cul£. ■ . 

To* better understand the differences between people who -engage in 

• ' * - ■ * »/ 

* - t * * 

different roles, we investigated, the context p\ which the field agents must 
operate. We identified seven broad questions whicfr might yield differen- 

• 9 m x * 

tiation between ro*3es. They included: 

f What are the content areas in which they wqrk? „ "* <■ ' 

• How do field "agents distribute their 'time across 'activities?' 

• How intensive their work with schools? 
- t t % 

• Who' do field agents work with? 
* # To what extent are activities initiated by field agents? 

• Where do field agents' turn for the knowledge th§y neerd 
to do their work? 

1 • What strategies do they employ in working with schools?' 

.... .' '. • ;. V ' • 

» • * \ 

H * 4 



■I 



r 



• f 



These questions generated 32. measurable' dimensions taken from the Jnter- 

views an4 sui^eys. A comparison of people doing different activities along 

these 32 dimensions can help 'us answer two questions/ F^Lr'st ,„ where do 'pure 

* • . *~ * > - . ^ . ; / - 

monitors' differ from the two stfrts of a&sisters? 'Second, ,qn what dimen- 

sions are the combinations more lifcfe one pure type than^ another? . 



\ 



The differences between monitors and^ trainers are substantial. • They 
-appear on 14 different ^dimensions as descriWd in TabJLe 0 2. Hor dimensions 

Table 2 about here . - * 

\ * » > *■ • *« • 

. ■ — y--- . - . • '* . 

. where statistically significant differences exist between' tbe twq pure role * 0 ., 
types, wje have* plotted the scores" on ^ a cdntinuum .;an*d fi^W^indicated where* . 
the mixed types fall along fhat continuum so that comparisons can be -made. ^ . 
As might be expected, trainers provide substantially mo.re "service- to local 

* educators andy^e more welcomed in school* districts , ; More trainees work in . / 
areas* related to curriculum, conduct workshops, and wri'to^ materials and ; 
proposals. Trainers also engage in more long term Vojects.jequiring three, 
or more contacts with a school distinct,- 'work with teachers more, ;and^are' 
more frequently invited into school districts l5y the districts. They also 
refer to sources of information more often than* do monitors, an<J use a 

* * * * ■ v * * 

greater variety of strategies to build rapport with educators.' Monitors 
Jffe more concerned withVegal matters, and enter* the "■district .more often in • 

response' to state mandates. The' *seven monitor-trainers' act like monitors ■ 

> .» 1 • ' ' ' 

on 9 of 14 dimensions. They find a middle ground between the twtf pure 
types on the other 5 dimensions. These 'latter data are iflH.icated by the 

t « 
if* * x 

location* of the symbols (A). • ; **. * p , 

• . 4 ■ • 
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The differences between .monitors and those who specialize in liaison 
services are similar .although not *is extensive. These differences appear 
in only 7 of the 32 dimensions (Table 3). More liaison' specialists provide 
. assfst^nce' on administrative matters' They "also engage "in^more long-term 

projects and are* more proactive about delivering services than are irioni- 

» ' » * ■ 

tors. Liaison people also Tis e a wider raftge of knowledge sources "-than do 
monitors.' Liaison activities are usually notr initiated by the state. 

• • ■ „ ■ - ' ' - ■ ■ 

. . , : - ■ * • % f . 

• • < Table 3- about here ... • 



% . JThe monitor-liaison is much more of a blend. of the two pure' types th^n 
is the monitor-trainer. Monitor-liaisons score closer 6b the pi*re monitor 
on.' three dimensions and the pur,e liaison on three others while flailing in 
the middle on tl^e remaining. one. ^^^^^ ' * \ 

Explanations of the incompat^bilit^^etween— training— an<i— mon-it-or-ing 
turn in part upon decisions made hy. t^e,New Jersey Department of; Educa£ipn 
when the^ current enforcement system was set up. ^At that* time, , dominant 
fov eas in t he re paym e nt argued that its re&ponsil^jkies for assisting and 

enforcing were differept. ' • 

# r * 

The role of rnqnitoring and Approval is clearly vested 'in the 
SEA. The aim of school improvement Is vested in the LEA . . . 
The legislation is clear that the SEA can only intervene in the 
locaJL 1 school program if the LEA fails * to -take appropriate 
action. .However, while the legislation does not mandate an SEA 
* . ^ role in school improvement, LEAs expect assistance in this 
^'area. But ttifcy expect assistance in a manner which will/not 
- jeopardize their autonomy/' " 

(Ogden*, n.d.; p*3) ' ' 

In addition, ther^Xwas also apparently' some J concern that if enforcers 
offered assistance they might be limited. by theit??own advice. That is, they 



1 r 

might be unwilling to disapprove districts that followed' tl(eir recommends- 
tions. without achieving- the desired effect. The outcome of this thinking 
was that for the"pcfiod from 1975 through 1980, when our data were *col ijec- 
•ted, County Offices had the responsibility for monitoring and ElCs \or v< 

offering training. 

These- deliberations did not totally preclude County Offices from 
offering assistance, but when they did so it, was at the initiative of an* ^ 
individual field person or County Superintendent. ^Moreover, monitoring 
responsibilities were not reduced. As a result, field staff found signifi- 
cant barriers to expanding their role in the direction of more assistance. 
In! "fact their; .time for assistance declined. Field 'staff who worked , in ^ 
"county Offices before passage of the T&E law indicated that they spent more _ 
time providing assistance in the. earlier' period. Monitoring tasks preclu- % 
ded "help^. ' ; ' ; 



Moreover, the' field -person's relationship to the -state affects the 
strategies that are used t^ develop relationships with .local educators. ^ 
'Monitors rely on stare .initiatives to bring the m in. cerfact with locals ' 
(Table 2^ item E) .' They artless likely -to' stress technical expertise or 
use of media, (items Gl-2). As a result, local .educators have relatively 
little reason to trust the monitors. Wis no personal basis for -such 
•trust! The monitors have not* established that theyliave a special knowl- 
edge base to be relied ^on, and they are known to report infractions of 
the law to higher Officials thereby creating, problems for locals. ' For this 
reason, loca ls are^ less likely to request the monitors' services (item El). 

' Th^ factors that make- monitoring and training incompatible Ho ' not 
impede the combination of -monitoring and liaison to, -the same extent. 



T ~ 

21 ' 



Liaison work is more a matter of identifying needs, and finding resources to 
reduce \them than actually developing solutions. Tn the interviews we 



ccmducted, Monitors argued Jhat their work is, in effect, a needs <assess- 

ment Activity, Discrepancies between the current state of affairs and 
J * ■ & 

mandates are jieeds,^ar, at least they become, so on<^e they are reported *and 
the- threat of sanctions is intfokedl ■ Moreover, there is less , risk for the 
lacal'educatqr in following a suggestion to try a resource £han there is % in c 
developing the give-and-take "relationship required to receive assistance. 
Finally, liaison activities — making referrals, • passing on bits of imforma- 
tion, and so forth--are easier to fit 'in with more formally -defined moni- 

•toring, responsibilities than ,are training tasks. FoV instance^ the same 

? • * » 

old timers^who reported they had Inore time for assistance earlier indicated 

that under T&E the help they cobld offer was limited primarily- to making 

re f- etr-a-l s-t o_o. t h e ^lag en c i es_ _whic h JLs a liai son acfrj vi tv. 

• • •• '••> . ■•" " 

Implications 



^ Our examination T>f the role of Regional Educational Service Agencies 
in working with school districts ,has provided a useful opportunity to 
pyplore a number of quest i6ns about how external agencies can ■ promo te, 
knowledge use> In this final section, we turn to the policy and research 
implications of our findings. 

Policy Implications? 7 ^' . 

- Our findings offer a number of insights in the design problems of- v 
combining enforcement and assistance strategies; for promoting school 

' '■ ■ ■ ) 25 • ' 



improvement... /fhe 'problems of employing an enforcement- strategy are very 

apparent in our work. First, enforcement leads to a backlash/ It seems - 

unlikely that New Jersey ' s ' moni coring system will continue in its current. 

form for much longer because^,' external -pressures for local autonomy 
' '» ■ f^" v \, ' '* • \" : ' 

-Second/ if §§ clear that , the monitors, "themselves dislike their role a.nd , 

• . V . ";V^ V • •• - y-*-: 

seek to expand Predefine it so jthat. it has a more positive, assistance- 
oriented cast. ' >This predilection reflects both personal, preferences and 
recognition of the likelihood^ of counter-infl<(ence attempts; ^ ( 

^ We have also* identified -some rtfjtto*' difficulties of^qmb'injlng certain 
•kinds of assistance- and enforcement in the same, posit ipL - The major caveat 
to our conclusions' is that we ^examined a situation whe-re assistance fH^j. 
enforcement. functions were separated by policy Still, it* is difficult to 
combine monitoring with actual training. When pressed, the people who say 
they combine-the roles i.ndi'gate that they rarelg^ngage in such activities 
that' characterize training-including offering workshops, . developing 
materials, workingV curriculum concerns, and keeping up with information 
in' those fields. Even in;a well-staffed system where distance is not a 
•problem* the time requirements of monitoring seem to force, out -extensive 
"training, efforts. Local educators also s.eem' more willing to seek assis- 

• • , * . » * • . 

tance from individuals who do not have monitoring responsibilities. Thus," 
to ensure that . draining v is delivered, it is important tp divide monitoring 
''and training functions .by putting them -in separate agencies or at , least 
different, off ices. On the other hand, ijt 4s feasible for monitors to serve 
a liaison function bv helping to identify ..needs and resources and providing 
information on upcoming mandates and changes^ in interpretation. Without 
someone .else, prodding training assistance, however, the impact of su£h^ 



liaison*work is likely to be modest. Moreover, the. political benefits of 
'creating good wil] with the targets of enforcement seem to be minimal. 
Still, our data suggest that the best way to combine enforcement and 
as,sist3nce is to develop a dua] system where monitors concentrate on 
enforcement issues and make referrals to trainers. 

- .<\ 

Research Implications 

- °Our' study thas begun to explore the dynamics of the operation of 

-cenf^al-ri.e. , state and federal — systems for promoting local reform and 
i - - * ■ : 

knowledge use. fioweVer, it suggests a number of lines qf inquiry to be 
pursued in the future* /including questions about' (1) why central decision- 
ikers nake the decisions tHey do when designing systems to impact local 
service agencies, (2)* the dynamics of those systems, (3) how local profes- 
sional sVesponA to those systems, and (4) the Consequences of th<2 resulting 
changes for senSice delivery. 

Studies svich as this one" indicate that the question of how to design 
and implement a central system to impact on local- practice is quite com- 
plex I How do the decision makers involved decide what tfiey v should be doing 
and what is feasible' under their particuj^r circumstances? One can imagine 
that a variety'of economic, political,. and cultural factors come into play. 
For instance, a number of 'observers have identified the stated political 
culture — in particular its tradition of interventionist or recognition of 
local perogativ6s — as a major factor determining whether central agencies 
will even contemplate efforts to regulate local 'programs or -of fer improve- 

mentr-orierited assistance (Befke and^Moore, 1982; McLaughlin, 1981). The 

*• * 

national context is also undergoing a 'major ch'ange, not only with regard to 
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the levels of finding and the regulations governing programs in many areas, 
but also in the nation's willingness to give high priority to social . 
programs. In addition to, these factors, the knowledge base that decision- 
makers have about system design issues' could affect the options they 

* ( 
consider. Thus, it would be useful to know what alternatives they believe 

exist, which ones they see as technically feasible, arid what; they consider 
to be relevant evidence for the utility of different options. 

Another issue concerns the dynamics of the operation of systems for 
affecting local* practice. This study indicates some.of the difficulties in 
combining training and enforcement in two state contexts. However, it 
would be useful to examine how enforcement and assistance are combined in 
other contexts— both other states and other program areas--to learn how 
much the difficulties* identified here are situation-specific and how much 
they, are generic to the assistance and enforcement tasks. 

A third question concerns the way in which local officials respond to 
various combinations of enforcement and assistance* activities. It has-been 
suggested that enforcement and assistance are, mutually reinforcing; ^but 
when enforcement becomes the motivating factor for school districts, it 
.could undercut assistance efforts, i,n at least three ways. First, it could 
s create an "opportunistic" demand for assistance (Berman and .McLaughlin, 
1975). That is,. local officials could request assistance not to^solve what 
rfiey see as teal program ' problems , but to indicate their willingness to 
comply. Then, assistance might have' more symbolic than substantive value. 
It would not receive adqua.te . radministrative support, and the resulting 
efforts to strengthen programs would suffer. Second, enforcement efforts 
could curtail the sor* of risk-taking that is often a part of constructive 



^change .(Giaqqutata/ 1975) . If there is a likelihood that extreme sanctions 
will be. applied quickly ,—loca^ educators may be unwilling ^ or unable .to 

1 f 

explore local conditions and * seek new understandings and action alterna- 
tives. There is some evidence that this does happen when school districts 
are under pressure to comply with court desegregation orders (Pauly, 1978). 
Finally, too close an association between enforcers and helpers could 

•9 

» I 

preclude the development " of a trusj^r^ationship between locals and the 
helpers. , 

• The fourth issue concerns the ultimate consequences of enforcement- 
initiated knowledge use activities. The knowledge use we examine hexe is a 
benefit to professionals and' their organization. To what extent does such 
knowledge trickle down to where it benefits students? This is an extremely 
'difficult issue because knowledge-us'e processes "are complex, intermittent, 
stretched ov*r long time periods, and indirect (Weiss, 1977)* method- 
ological problems of tracing out such impacts are severe (Fullan, 1980). 
Still, this is a concern that plagues not" just inforcement-driven forts — 
but. knowledge use programs more generally — arf3 efforts ar^^underway to 
address it. / • , 

*% ' * Summary 

This review .of the activities of field staff in three different kinds 
of RESAs Hn two states suggests that those charged with enforcement respond 
sibility would^like to • provide sucji assistance themselves. There are 
important limitations, however, to ,the kinds of - assistance ,they can pro-* 
, vide. Ttf<^ can link districts tq sources of training and specialized 
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assistance, but they cannot provide it themselves. Jn sum, it seems to be 
useful to have someone "wear the black hat," but no one wants to do it.*. 




FOOTNOTES 



The work upon wliich this publication is based was fundecj *by the 
National Institute of Education, . Department of Education. The 
opinions expressed, in this publication, do not necessarily reflect the 
position of policy of the National Institute of Education, and no 
official endorsement by the National Institute of Education should be 
inferred. Our thanks to Dick Corbett and Karen Louis for provoking us 
to write this article. Jerry Murphy and Karen Louis provided helpful 
critiques to an earlier version of this paper. . 

The main mission at RBS is to . . apply the latest results of 
educational research and development in the improvement of elementary 
and secbdary Schools . ..." within the geographical region. Since 
Pennsylvania and New Jersey are within our regional boundary, the 
agencies in those states were obvious candidates for this research 
effort. 

The County Office site selection was determined by our choice of EIC 
sites. Oncq we had decided which ElCs.to visit, we chose to visit all 
the County Offices in the two EIC regions. * ■ . ■ 

ftji orthogonal factor analysis with varimax rotation produced the thrfee 
clusters of activities which we* have labeled expert/trainer , liaison, 
monitor.. A technical discussion of the results may be found in 
Firestone and Wilson, 1981. Briefly, our criterion far inclusion in a 
factor was d loading of ±.50 and with that in force we found that 8 o£ 
pur initial 11 activity items fell into one of - our three activity 
clusters. . < . 

Individual role scores were calculated by gumming, the items, which the 
factor analysis suggested wolild cohere .to form a single role. " The 
fa'otor analysis indicated four items in the" expert/trainer * category 
but upon closer examination we found that two of these items were the 
least frequently mentioned of the, eleVen we asked so^ they were dropped 
from subsequent analyses. 

One-way analyses of variance were .performed on each of the indices. 
Results indicated that there were significant between- agency scores 
for - training and monitoring but not liaison. ^ Therefor^ it As 
appropriate to examine agency scores on the two * dimensions of field 
agent rdles as an indication of the extent to which helping (training) 
and enforcing . (monitoring) missions are carried out in practice. 

These numbers refer to 'specif ic interviews. The first two digits for 
the field' agent interviews Cp. 21) represent an agency site, lumbers 
tfl-11 are from the IUs in Pennsylvania, 12-13 are from EICs and 14-23 
from County Offices "in New Jersey. % 



We defined as a high scorer any person % who scored in the top one-third 
\of the distribution for the activity. Note that .it is possible for a 
f±eld agent to -score high on more than one activity. 

As described earlier, a high scoring person is one who scores in the 
top one-third of that activity distribution. Any one field agent can 
conceivably score high on anywhere from none to all three of the 
activities. The distributions from* our sample are' presented in 
Table F. ""The combined or mixed types are those who score high on more 
than one activity. * ^ 
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-¥able 1: Breakdown of Field Argents, 
by Activity Type 



Activity Type 

Monitor only • , ' 

Trainer only 

Liaison only . 

Monitor-Trainer 

Mpnitor-Liaison" 

Trainer-Liaisdn 

Monitor-Trainer-Liaison 

None 



N " 
19 
17 
13 
7 

15 
22 
1 

39 
133 1 



1 
14 

13 

-10 ■ 
5 , 

11 

17 
1 

"29 



There were five respondents who did not report sufficient data to be 
included in this analysis. V 
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30 



TABLE 2: Distribution of M6njUtors, Trainers and Monitor-Trainers (A) 
Across Distinctive Contextual Dimensions 



^PURE- 
MONITORS / 



Content Areas (X who mention) : 

(1) Curriculum 

(2) Legal Issues 

Activities (% who mention) : 

(1) Workshops 

(2) Writing 
-<3) Monitoring 

Intensity of Contact 

(1) Number of Long Term 
Projects^ with LEAs 

(2) Pet. of Time Spent 

on Long Term Projects 
• 

Level of Contact in LEA 
(X of time spent with); 

(1) Teacher * * 

Initiation of Contacts 
(% of contacts initiated 'by) : 

(1) LEA 



A2 



31 



88 



A 
~7T 




2.3 



11.6 



21 



26 30 



(2X State 



I 



38 



Knowledge Sources (frequency of use):'' 

(1) Paper (e.g., books, articles) 

(2) Institutional (e.g., state and 
federal agencies), ♦ 



PURE 

TRAINERS 



• A 



18,2 



30 



22 



10.7 



12*4 



578 



6*7 



Strategies for Creating $h Interest and 
for "Delivering 

(1) Expertise 

(2) Media 



for Delivering Services 1% who mention): 

A 
0 



r 



19 



A 
Ik 



31 



Categories A, B. and G are taken from our semi-structured interview data 

while the balance are from the survey data. The rationale for including 
these particular dimensions from the total of 32 was, statistical. We 
computed a t-test for the survey items and' Chi squares for the interview 
' i$ems. We only included those items in this table which showed signifi- 
cant differences' at the .05 level between the two pure types. 

The Hymhol (A) Indicates mean score for monitor-trainers. 

34 

31 



77 



29 



88 



77 



24 



10.7 



21.5 



42 



l 47 



13 



15.5 



8.2- 



59 



71- 



TABLE. 3: Distribution of Liaisons-, Monitors and Liaison-Monitors (^y 
Across Distinctive Contextual Dimensions-** 



_L^. Content Areas (% who'mention) 
(1) Administration 

B. Activities (%'who mention^:- 
(1) Monitoring 

C. mtensity of Contact 

(1) 'Number of Long Term 
Projects with LEAs 



D. Level of Contact in L(EA 
(no differences) 

E. Initiation" of Contacts 
, (% of contacts- initiated b^) 

'(1) RESA t . . 



(2) State 

F. Knowledge Sources ' - • 

(1) Paper (e.g., books, articles) 

(2) Institutional (e.g. , .state and 
federal agencies) v 



G. Strategies 

(no differences) 



PURE . ... 
MONITORS * 




' , ,PURF . 

^* Y T" lain /MT O ' 

V LI/HpONS. 


1 * t 


> • 


- 1 


0" 13 


° 


77 


• 1" A 






•81 80 




• . ' 8 


to 

1 




A ^ '1 


2.3 




6 -?-. 9.2 



25 



29 * 



38 ~ 



26 



10.7 



5.8 
\ 



1 2 # if 



Categories A, B, and G are. taken*" from our semi-structured 'interview data * 
while the balance are from the survey data. The rationale for including . 
these particular dimensions frppi the total" of 32_ was statistical. ; We 
computed a.t-test for the survey items arid Chi squares for*the interview 
items. We only .included those items in this 'table which showed significant 
differences at the # 05 level/between the two pure types'* 

The symbol' (A) indicates mean tscore far monitor-trailers. ' \ * 
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I - IV 
* f. = EIC 

C = County Office 
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Figure 1. Scattergram of Mean Agency" Scores, Monitor x Trainer Activities 
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